STB-VMM: Swin Transformer based Video Motion Magnification
نویسندگان
چکیده
The goal of video motion magnification techniques is to magnify small motions in a reveal previously invisible or unseen movement. Its uses extend from bio-medical applications and deepfake detection structural modal analysis predictive maintenance. However, discerning noise complex task, especially when attempting very subtle, often sub-pixel As result, generally suffer noisy blurry outputs. This work presents new state-of-the-art model based on the Swin Transformer, which offers better tolerance inputs as well higher-quality outputs that exhibit less noise, blurriness, artifacts than prior-art. Improvements output image quality will enable more precise measurements for any application reliant magnified sequences, may further development technical fields.
منابع مشابه
A Review: Eulerian Video Motion Magnification
Thispaper reviews computational techniques to efficiently represent, analyse and visualise both shortterm and long-term temporal variation in video and image sequences. This paper reveals temporal variation in videos that are imperceptible to the naked eye. The method takes a standard video sequence as an input, and applies spatial decomposition, followed by temporal filtering to the frames whi...
متن کاملStructural Modal Identification Through High Speed Camera Video: Motion Magnification
Video cameras offer the unique capability of collecting high density spatial data from a distant scene of interest. They could be employed as remote monitoring or inspection sensors because of their commonplace use, simplicity, and relatively low cost. The difficulty is in interpreting the video data into a usable format, such as displacement, that is familiar to engineers. A methodology called...
متن کاملAn Improved Motion Vector Estimation Approach for Video Error Concealment Based on the Video Scene Analysis
In order to enhance the accuracy of the motion vector (MV) estimation and also reduce the error propagation issue during the estimation, in this paper, a new adaptive error concealment (EC) approach is proposed based on the information extracted from the video scene. In this regard, the motion information of the video scene around the degraded MB is first analyzed to estimate the motion type of...
متن کاملMulti-point Vibration Measurement for Mode Identification of Bridge Structures using Video-based Motion Magnification
Image-based vibration mode identification gained increased attentions in civil and construction communities. A recent video-based motion magnification method was developed to measure and visualize small structure motions. This new approach presents a potential for low-cost vibration measurement and mode shape identification. Pilot studies using this approach on simple rigid body structures was ...
متن کاملA New Wavelet Based Spatio-temporal Method for Magnification of Subtle Motions in Video
Video magnification is a computational procedure to reveal subtle variations during video frames that are invisible to the naked eye. A new spatio-temporal method which makes use of connectivity based mapping of the wavelet sub-bands is introduced here for exaggerating of small motions during video frames. In this method, firstly the wavelet transformed frames are mapped to connectivity space a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Knowledge Based Systems
سال: 2023
ISSN: ['1872-7409', '0950-7051']
DOI: https://doi.org/10.1016/j.knosys.2023.110493